AMENDMENTS TO THE CLAIMS 

This listing of claims will replace all prior versions and listings of claims in the application. 



11.-29. (cancelled) 

30. (currently amended) A m e thod according to claim 1 L wher e in: A method for 
annotating video, comprising: 

receiving video, said video depicts a surface at a live event; 

receiving a graphic manually created by a human operator during said live event; and 
blending said graphic with said video such that said graphic appears to be drawn on 
said surface, said step of blending being performed during said live event; 
wherein said step of blending includes performing a flicker filter. 

31. (currently amended) A m e thod according to claim IK wh e r e in: A method for 
annotating video, comprising: 

receiving video, said video depicts a surface at a live event, said video is captured by 
a first camera; 

receiving a graphic manually created by a human operator during said live event, said 
graphic includes a curv e ; curve, said curve is represented as a set of quadrilaterals; and 
said curv e is r e pr e s e nt e d as a s e t of quadrilat e rals; and 

blending said graphic with said video such that said graphic appears to be drawn on 
said surface, said step of blending being performed during said live event, said step of 
blending includes tessellating said quadrilaterals if said first camera has been zoomed past a 
threshold. 

32. (cancelled) 

33. (previously presented) A method for annotating video, comprising the steps 

of: 

receiving video, at least a portion of said video depicts at least a portion of a surface at 
a live event and a set of one or more objects occluding said surface; 
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receiving a graphic manually created by a human operator during said live event; and 
blending said graphic with said portion of said video without drawing said graphic 

over said objects, said steps of receiving video, receiving a graphic and blending are 

performed during said live event. 

34. (previously presented) A method according to claim 33, wherein said 
step of blending includes the steps of: 

accessing color data for said video; 

using said color data to access stored blending values, said stored blending values are 
organized by colors; and 

causing a blending of said graphic with said video based on using said blending 

values. 

35. (previously presented) A method according to claim 34, further 
comprising the steps of: 

receiving a selection of a portion of an image, said portion of said image includes a 
set of colors; 

receiving a first blending value for said set of colors; and 
storing said first blending values. 

36. (previously presented) A method according to claim 34, wherein: 
said step of using includes the steps of: 

comparing a first color value for a first pixel in said video to a color map, said 
color map stores color values and corresponding blending values, and 

identifying a first blending value corresponding to said first color value based 
on said color map; and 

said step of causing a blending includes using said first blending value as part of a 
process to blend said first pixel with a corresponding pixel in said graphic. 

37. (previously presented) A method according to claim 33, wherein: 

said step of receiving a graphic includes receiving two dimensional position 
information for said graphic created in relation to a two dimensional image. 
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38. (previously presented) A method according to claim 37, further 
comprising the steps of: 

converting a first set of one or more two dimensional positions to one or more three 
dimensional locations, said first set of one or more two dimensional positions are based on 
said two dimensional position information for said graphic; and 

converting said one or more three dimensional locations to a second set of one or 
more two dimensional positions, said step of blending includes blending said graphic with 
said video based on said second set of one or more two dimensional positions. 

39. (previously presented) A method according to claim 38, wherein: 
said two dimensional image is part of a first video frame; and 

said step of blending includes blending said graphic with a second video frame 
different from said first video frame. 

40. (previously presented) A method according to claim 33, fiirther 
comprising the step of: 

smoothing said graphic prior to said step of blending, said graphic is a drawing. 

41. (previously presented) A method according to claim 33, wherein said 
step of blending includes: 

adding said graphic to a first video image at a first position in said first video image; 
adding said graphic to a second video image at a second position in said second video 

image; 

said first position is different than said second position; 

said first position corresponds to a position of an image of a first portion of said 
surface in said first video image; and 

said second position corresponds to a position of said image of said first portion of 
said surface in said second video image. 

42. (previously presented) A method for annotating video, comprising the 
steps of: 

receiving video, said video depicts a surface at said live event; 
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receiving two dimensional position information for at least a portion of a graphic 
created in relation to a two dimensional image; 

converting a first set of one or more two dimensional positions to one or more three 
dimensional locations, said one or more two dimensional positions correspond to said two 
dimensional position information; 

converting said one or more three dimensional locations to a second set of one or 
more two dimensional positions; and 

blending said graphic with said video based on said second set of one or more two 
dimensional positions. 

43. (previously presented) A method according to claim 42, further comprising 
the steps of: 

receiving camera sensor data for a first camera, said video being captured by said first 
camera, said step of converting said one or more three dimensional locations to a second set 
of one or more two dimensional positions is performed using said camera sensor data for said 
first camera. 

44. (previously presented) A method according to claim 43, further 
comprising the steps of: 

receiving camera sensor data for a second camera, said two dimensional image being 
captured by said second camera, said step of converting said first set of one or more two 
dimensional positions to one or more three dimensional locations uses said camera sensor 
data for said second camera. 

45. (previously presented) A method according to claim 42, further 
comprising the steps of: 

receiving camera sensor data for a first camera, said two dimensional image being 
captured by said first camera, said step of converting said first set of one or more two 
dimensional positions to one or more three dimensional locations uses said camera data for 
said first camera. 

46. (previously presented) A method according to claim 42, wherein: 
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said two dimensional position information is different than said first set of one or 
more two dimensional positions. 

47. (previously presented) A method according to claim 42, further 
comprising the steps of: 

dividing said graphic into segments based on said two dimensional position 
information, said first set of one or more two dimensional positions are end points of said 
segments; and 

thickening said graphic after said step of converting a first set of one or more two 
dimensional positions to one or more three dimensional locations. 

48. (previously presented) A method according to claim 42, wherein: 
said two dimensional image is part of a first video frame; and 

said step of blending includes blending said graphic with a second video frame 
different from said first video frame. 

49. (previously presented) A method according to claim 42, wherein: 
said two dimensional image is part of a first video fi-ame from a first camera; and 
said step of blending includes blending said graphic with a second video fi-ame from a 

second camera. 

50. (previously presented) A method according to claim 42, wherein: 

said first set of one or more two dimensional positions pertains to only a new portion 
of said graphic; and 

said one or more three dimensional locations pertain to said graphic as a whole. 

51. (previously presented) A method according to claim 42, further 
comprising the step of: 

creating a three dimensional model of at least a portion of said surface, said step of 
converting said first set of one or more two dimensional positions to one or more three 
dimensional locations uses said model. 
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52. (previously presented) A method according to claim 42, further 
comprising the step of: 

smoothing said graphic prior to said step of blending, said graphic is a drawing. 

53. (cancelled) 

54. (cancelled) 

55. (currently amended) A m e thod according to claim 53, wh e r e in s aid st e p of 
smoothing said drawing includ e s th e st e ps of: A method for annotating video, comprising: 

receiving video, said video depicts a surface at a live event: 

receiving at least a portion of a drawing manually created by a human operator during 
said live event; 

smoothing said drawing, said smoothing includes: 
receiving a new point; point, 

adding said new point to a control group if there are is a sufficient distance 

between said new point and another point in said control group; group, 

drawing a line between said new point and said another point in said control 

group if there is not more than two points in said control group; group, and 

removing a next to last point in said control group and fitting a Bezier spline 

through points in said control group, if there are more than two points in said control group. 
group: and 

blending said smoothed drawing with said video during said live event. 

56. (previously presented) A method for blending images, comprising the steps 

of: 

storing blending values for a set of colors; 
receiving a first image; 

receiving a second image after said step of storing; 
accessing color data for said second image; 
comparing said color data to said set of colors; and 
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causing a blending of said first image with said second image based on using one or 
more blending values for colors of said set of colors that match said color data for said 
second image. 

57. (previously presented) A method according to claim 56, further 
comprising the steps of: 

receiving a selection of a portion of a third image, said portion of said third image 
includes a subset of said set of colors; and 

receiving one or more blending values for said subset of said set of colors. 

58. (previously presented) A method according to claim 57, wherein: 
said second image is part of a video of an event; and 

said first image is an effect to be added to said video of said event, 

59. (previously presented) A method according to claim 58, wherein: 
said video is live video; and 

said step of receiving one or more blending values includes receiving a number from 
an operator indicating how to blend said first image with said second image. 

60. (previously presented) A method according to claim 56, wherein: 
said blending values are alpha percentages. 

61 . (previously presented) A method according to claim 56, wherein: 
said step of comparing includes the steps of: 

comparing a first color value for a first pixel in said second image to a color 
map, said color map stores color values for said set of colors and said blending values for said 
set of colors, and 

identifying a first blending value corresponding to said first color value based 
on said color map; and 

said step of causing a blending includes using said first blending value as part of a 
process to blend said first pixel with a corresponding pixel in said first image. 

62. (previously presented) A method according to claim 56, wherein: 
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said steps of accessing and comparing include the steps of: 

accessing a first pixel in said second image, said first pixel having a first color 

value, 

accessing additional pixels nearby to said first pixel in said second image, said 
additional pixels having additional color values, 

comparing a first color value for said first pixel to a color map, said color map 
stores color values for said set of colors and said blending values for said set of colors, 

comparing said additional color values to said color map, 

identifying a first blending value corresponding to said first color value based 
on said color map, 

identifying additional blending values corresponding to said additional color 
values based on said color map, 

calculating an average of said first blending value and said additional blending 

values, and 

adjusting said average based on a weighting factor; and 
said step of causing a blending includes using said adjusted average to blend said first 
pixel with a corresponding pixel in said first image. 

63. (previously presented) A method according to claim 56, wherein: 
said step of causing a blending includes performing a flicker filter. 

64. (previously presented) A method according to claim 56, wherein: 
said set of colors includes a first subset of colors and a second subset of colors; 
said first subset of colors is associated with a first blending value; and 

said second subset of colors represents a taper zone having blending values ranging 
from at or near said first blending value toward a second blending value, said second 
blending value represents no blending of said first image with said second image. 

65. (previously presented) A method according to claim 56, wherein: 
said set of colors includes multiple visibly distinct colors. 

66. (previously presented) A method according to claim 56, wherein: 
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said step of accessing color data includes accessing color data for a first portion of 
said second image, said first portion of said second image corresponds in position to said first 
image; and 

said step of causing a blending includes causing said first image to be blended with 
said first portion of said second image and not other portions of said second image. 

67. (previously presented) A method according to claim 56, wherein: 
said second image is a live video image of a live event; and 

said steps of storing, receiving a first image, receiving a second image, accessing, 
comparing and causing are performed during said live event. 

68. (previously presented) A method according claim 67, further including 
the step of: 

updating said blending values for said set of colors during said live event. 

69. (previously presented) An apparatus, comprising: 
one or more processors; 

an input device in communication with said one or more processors; 
an output device in communication with said one or more processors; and 
at least one storage device in communication with said one or more processors, said 
one or more processors perform a method comprising the steps of: 

storing blending values for a set of colors, 

receiving a first image, 

receiving a second image, 

accessing color data for said second image, 

comparing said color data to said set of colors, and 

causing a blending of said first image with said second image based on using 
one or more blending values for colors of said set of colors that match said color data for said 
second image. 

70. (previously presented) An apparatus according to claim 69, wherein 
said method fiirther includes the steps of: 
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receiving a selection of a portion of a third image, said portion of said third image 
includes a subset of said set of colors; and 

receiving one or more blending values for said subset of said set of colors. 

71 . (previously presented) An apparatus according to claim 69, wherein: 
said step of comparing includes the steps of: 

comparing a first color value for a first pixel of said second image to a color 
map, said color map stores color values for said set of colors and said blending values for said 
set of colors, and 

identifying a first blending value corresponding to said first color value based 
on said color map; and 

said step of causing a blending includes using said first blending value as part of a 
process to blend said first pixel with a corresponding pixel in said first image. 

72. (previously presented) An apparatus according to claim 69, wherein: 
said steps of accessing and comparing include the steps of: 

accessing a first pixel in said second image, said first pixel having a first color 

value, 

accessing additional pixels nearby to said first pixel in said second image, said 
additional pixels having additional color values, 

comparing a first color value for said first pixel to a color map, said color map 
stores color values for said set of colors and said blending values for said set of colors, 

comparing said additional color values to said color map, 

identifying a first blending value corresponding to said first color value based 
on said color map, 

identifying additional blending values corresponding to said additional color 
values based on said color map, 

calculating an average of said first blending value and said additional blending 

values, and 

adjusting said average based on a weighting factor; and 
said step of causing a blending includes using said adjusted average to blend said first 
pixel with a corresponding pixel in said first image. 
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73 . (previously presented) An apparatus according to claim 69, wherein: 
said step of causing a blending includes performing a flicker filter. 

74. (previously presented) An apparatus according to claim 69, wherein: 
said set of colors includes a first subset of colors and a second subset of colors; 
said first subset of colors is associated with a first blending value; and 

said second subset of colors represents a taper zone having blending values ranging 
fi:om at or near said first blending value to a second blending value, said second blending 
value represents no or minimal blending of said first image with said second image. 

75. (previously presented) An apparatus according to claim 69, wherein: 
set of colors includes multiple visibly distinct colors. 

76. (previously presented) An apparatus according to claim 69, wherein: 
said step of accessing color data includes accessing color data for a first portion of 

said second image, said first portion of said second image corresponds in position to said first 
image; and 

said step of causing a blending includes causing said first image to be blended with 
said first portion of said second image and not other portions of said second image. 

77. (previously presented) An apparatus according to claim 69, wherein: 
said second image is a live video image of a live event; and 

said steps of storing, receiving a first image, receiving a second image, accessing, 
comparing and causing are performed during said live event. 

78. (previously presented) An apparatus according claim 77, wherein said 
method fiirther includes the step of: 

updating said blending values for said set of colors during said live event. 



79. - 84. (cancelled) 



85. (previously presented) An apparatus, comprising: 
one or more processors; 
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a drawing device in communication with said one or more processors; 
an output device in communication with said one or more processors; and 
at least one storage device in communication with said one or more processors, said 
one or more processors perform a method comprising the steps of: 

receiving video, at least a portion of said video depicts at least a portion of a 
surface at a live event and a set of one or more objects occluding said surface, 

receiving a graphic manually created by a human operator during said live 

event, and 

causing a blending of a graphic with said portion of said video without 
drawing said graphic over said objects, said steps of receiving video, receiving a graphic and 
causing are performed during said live event. 

86. (previously presented) An apparatus according to claim 85, wherein 
said step of causing a blending includes the steps of: 

accessing color data for said video; 

using said color data to access stored blending values, said stored blending values are 
organized by colors; and 

causing a blending of said graphic with said video based on using said blending 

values. 

87. (previously presented) An apparatus according to claim 86, wherein 
said method further includes the steps of: 

receiving a selection of a portion of an image, said portion of said image includes a 
set of colors; 

receiving a first blending value for said set of colors; and 
storing said first blending value. 

88. (previously presented) An apparatus according to claim 87, wherein: 
said steps of accessing and using include the steps of: 

accessing a first pixel in said video, 

comparing a first color value for said first pixel to a color map, said color map 
stores color values and corresponding blending values, and 
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identifying a first blending value corresponding to said first color value based 
on said color map; and 

said step of causing a blending includes using said first blending value as part of a 
process to blend said first pixel with a corresponding pixel in said graphic. 

89. (previously presented) An apparatus according to claim 85, wherein: 
said step of receiving a graphic includes receiving two dimensional position 

information for said graphic created in relation to a two dimensional image; and 
said method further includes the steps of 

converting a first set of one or more two dimensional positions to one or more 
three dimensional locations, said first set of one or more two dimensional positions 
correspond to said two dimensional position information for said graphic, and 

converting said one or more three dimensional locations to a second set of one 
or more two dimensional positions, said step of blending includes blending said graphic with 
said video based on said second set of one or more two dimensional positions. 

90. (previously presented) An apparatus according to claim 85, wherein 
said method further includes the steps of: 

smoothing said graphic prior to said step of blending, said graphic is a drawing. 

91. (previously presented) An apparatus according to claim 85, wherein 
said step of causing a blending includes: 

adding said graphic to a first video image at a first position in said first video image; 
adding said graphic to a second video image at a second position in said second video 

image; 

said first position is different than said second position; 

said first position corresponds to a position of an image of a first portion of said 
surface in said first video image; and 

said second position corresponds to a position of said image of said first portion of 
said surface in said second video image. 



92. (previously presented) An apparatus, comprising: 

one or more processors; 
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a drawing device in communication with said one or more processors; 
an output device in communication with said one or more processors; and 
at least one storage device in communication with said one or more processors, said 
one or more processors perform a method comprising the steps of: 

receiving video, said video depicts a surface at said Hve event, 
receiving two dimensional position information for at least a portion of a 
graphic created in relation to a two dimensional image, 

converting a first set of one or more two dimensional positions to one or more 
three dimensional locations, said first set of one or more two dimensional positions 
correspond to said two dimensional position information, 

converting said one or more three dimensional locations to a second set of one 
or more two dimensional positions, and 

causing a blending of said graphic with said video based on said second set of 
one or more two dimensional positions. 

93. (previously presented) An apparatus according to claim 92, further 
comprising: 

a first set of one or more camera view sensors, said method further includes the step 
of receiving camera sensor data for a first camera from said first set of one or more camera 
view sensors, said video being captured by said first camera, said step of converting said one 
or more three dimensional locations to a second set of one or more two dimensional positions 
is performed based on said camera sensor data for said first camera. 

94. (previously presented) An apparatus according to claim 93, further 
comprising: 

a second set of one or more camera view sensors, said method further including the 
step of receiving camera sensor data for a second camera from said second set of one or more 
camera view sensors, said two dimensional image being captured by said second camera, said 
step of converting said first set of one or more two dimensional positions to one or more three 
dimensional locations is performed based on said camera sensor data for said second camera. 

95. (previously presented) An apparatus according to claim 92, further 
comprising: 
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a first set of one or more camera view sensors, said method further including the step 
of receiving camera sensor data for a first camera firom said first set of one or more camera 
view sensors, said two dimensional image being captured by said first camera, said step of 
converting said first set of one or more two dimensional positions to one or more three 
dimensional locations is performed based on said camera sensor data for said first camera. 

96. (previously presented) An apparatus according to claim 92, wherein: 
said first set of one or more two dimensional positions pertains to only a new portion 

of said graphic; and 

said one or more three dimensional locations pertain to said graphic in its entirety. 

97. (previously presented) An apparatus according to claim 92, wherein 
said method further includes the step of: 

smoothing said graphic prior to said step of blending, said graphic is a drawing. 

98. -104. (cancelled) 

105. (currently amended) A method according to claim 103, wh e r e in: A method 
for annotating video, comprising: 

receiving video, said video depicts a surface at a live event; 

manually adding a graphic to said video during said live event: and 

maintaining said graphic in said video such that said graphic appears to be drawn on 

said surface, said manually adding and maintaining includes adding a pre-defined image into 

said video; 

wherein said step of adding a pre-defined image includes determining an amount of 
time that a touch screen is engaged and adding said pre-defined image if said touch screen is 
engaged for less than a predetermined amount of time. 

106. (cancelled) 

107. (currently amended) A m e thod according to claim 103, wh e r e in said st e p of 
adding a pr e d e fin e d imag e compris e s th e st e ps of: A method for annotating video, 
comprising: 

-16- 

Attomey Docket No.: SPTV-01038USO 
sptv/i038/1038.resp-002 



receiving video, said video depicts a surface at a live event: 

manually adding a graphic to said video during said live event: and 

maintaining said graphic in said video such that said graphic appears to be drawn on 

said surface, said manually adding and maintaining includes adding a pre-defined image into 

said video: 

wherein adding a pre-defined image includes: 

receiving a first two dimensional position in said video corresponding to said 

pre-defined imag e ; image. 

converting said two dimensional position to a three dimensional location in 

relation to said live e v e nt; event. 

converting said three dimensional location to a second two dimensional 

position in said vid e o; video, and 

^blending said pre-defined image with said video at said second two 

dimensional position. 

108. (previously presented) A method according to claim 107, further comprising 
the steps of: 

receiving camera sensor data for a first camera, said video being captured by said first 
camera, said step of converting said three dimensional location is based on said camera 
sensor data for said first camera. 

109. (previously presented) A method according to claim 107, wherein: 
said pre-defined image is initially added to a first video field; and 

said step of maintaining includes blending said pre-defined image with a second video 
field later in time than said first video field. 

110. (previously presented) A method according to claim 107, wherein: 

said pre-defined image is initially added to a first video field fi-om a first camera; and 
said step of maintaining includes blending said pre-defined image with a second video 
field from a second camera. 

111. (previously presented) A method according to claim 107, further comprising 
the step of: 
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creating a model of at least a portion of said surface, said step of converting two 
dimensional position to a three dimensional locations is performed using said model. 

112.-115. (cancelled) 

116. (currently amended) An apparatus according to claim 115, wh e r e in: An 
apparatus for annotating video, comprising: 

a storage medium: and 

one or more processors in communication with said storage medium, said one or more 
processor perform a method comprising: 

receiving video, said video depicts a surface at a live event, 
manually adding a graphic to said video during said live event, and 
maintaining said graphic in said video such that said graphic appears to be 
drawn on said surface, said manually adding and maintaining include adding a pre- 
defined image into said video: 

wherein prior to adding said graphic to said video, at least a portion of said video 
depicts at least a portion of said surface at said live event and a set of one or more objects 
occluding said surface; and 

wherein said steps of adding and maintaining include adding said pre-defined image 
with said portion of said video without drawing said pre-defined image over said objects. 

117. -122. (cancelled) 

123. (currently amended) An apparatus according to claim 115, wh e r e in: An 
apparatus for annotating video, comprising: 
a storage medium: and 

one or more processor in communication with said storage medium, said one or more 

processor perform a method comprising: 

receiving video, said video depicts a surface at a live event , 
manually adding a graphic to said video during said live event, and 
maintaining said graphic in said video such that said graphic appears to be 

drawn on said surface, said manually adding and maintaining include adding a pre-defined 

image into said video: 
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wherein said steps of manually adding and maintaining are performed without using 
image recognition. 

124. (cancelled) 

125. (cancelled) 

126. (currently amended) One or mor e proc es sor r e adabl e storag e d e vic e s 
according to claim 125, wherein: One or more processor readable storage devices for storing 
processor readable code, said processor readable code for programming one or more 
processors to perform a method comprising: 

receiving video, said video depicts a surface at a Hve event: 

providing for the manual addition of a graphic to said video during said live event: 

and 

maintaining said graphic in said video such that said graphic appears to be drawn on 
said surface, said providing and maintaining include adding a pre-defined image into said 
video: 

wherein prior to adding said graphic to said video, at least a portion of said video 
depicts at least a portion of said surface at said Uve event and a set of one or more objects 
occluding said surface; and 

wherein said step of maintaining include adding said pre-defined image with said 
portion of said video without drawing said pre-defined image over said objects. 

127. -142. (cancelled) 
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